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Abstract 

Background: Implementing new initiatives and physical activity interventions in schools represents a myriad of 
challenges that if overcome can potentially facilitate a range of behavioural changes. The aim of this paper is to 
describe the process evaluation of specific design constructs used in the GLAMA (Girls! Lead! Achieve! Mentor! 
Activate!) peer leadership and physical activity pilot project. Conducted in a state secondary school in Australia, the 
intervention was designed to provide students with opportunities to develop leadership skills, school and social 
connectedness in addition to a range of physical activity experiences. 

Methods: This process evaluation used the RE-AIM (Reach, Efficacy, Adoption, Implementation and Maintenance) 
health promotion evaluation framework to assess three design constructs of the intervention: the effectiveness of 
leadership training and leader preparedness, activity suitability and participation, and the barriers to 
implementation of the intervention and potential solutions to overcome these barriers. As it was not the specific 
aim of this pilot, no behavioural change data were collected from students. Data were collected using a mixed 
methods approach including student questionnaires, teachers and researchers reporting on their own observations 
and feedback from students. 

Results: There were three main considerations evident across more than one RE-AIM dimension that need to be 
addressed to assist with future GLAMA dissemination. Firstly, the development of teacher, school and student 
participation. This needs to be through a variety of professional development opportunities for teachers, 
integration of the program within timetabled classes within the school and promoting the program to students as 
an opportunity to develop a range of skills to apply to future learning and workplace environments. Secondly, the 
successful translation of leadership training to practice is necessary to ensure that leaders are effectively able to 
motivate, facilitate and activate their teams. Finally, the need for consistent activity implementation requires 
sequential, competitive elements, purposeful team selection and clearly defined scoring and time periods for team 
'challenges'. 

Conclusions: Factors that have the greatest impact on intervention success are those that come from within the 
school setting including: the structure of the curriculum, pressure to meet curriculum and assessment content, lack 
of support for new initiatives, multiple programs already running within the school, time allowances for teachers, 
appropriate training for teachers, and support for students to participate. These barriers need to be considered 
when developing all secondary school interventions. 
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Background 

Schools are recognised as key health settings and their 
importance in promoting knowledge of physical activity 
and healthy lifestyle behaviours via physical education 
and physical activity programs is well documented [1,2]. 
Despite this recognition, there are a lack of effective 
intervention strategies to promote physical activity in 
school children; therefore the development of effective 
physical activity interventions in schools continues to be 
a priority [3], Nevertheless, promoting physical activity 
and healthy lifestyle behaviours among children and 
adolescents is a complex challenge [4], especially in a 
school context with many competing educational out- 
comes and institutional constraints. 

School-based interventions are appropriate in many 
ways due to the level of continuous, intensive contact 
with students during their developmental years [5]. 
However, previously reported difficulties with imple- 
menting a range of interventions in schools have 
included the; lack of teacher participation, lack of pro- 
gram readiness, absence of program advocates, inade- 
quacy of funding, reduction in infrastructure, poor 
association between the program's key features and 
organization routines, limited teacher training and sup- 
port, insufficient amount of program materials, and 
inconsistent staffing [6-8]. Ultimately, effective interven- 
tions require the combination of careful planning and 
the engagement of the whole school community. 

Notwithstanding the difficulties associated with imple- 
menting school-based interventions, the constant drive 
for schools and teachers to meet students' needs neces- 
sitates the adaptation of existing content as well as the 
successful implementation of new initiatives and inter- 
ventions. Teachers are aware of their own difficulties 
facilitating engaging programs, especially in the area of 
physical activity and physical education [9]. Subse- 
quently, teachers need to consider a range of teaching 
strategies, styles and methods for student engagement to 
ensure learning outcomes for all students. 

One such strategy which involves peer assisted learn- 
ing, encourages development across all learning 
domains. Peer assisted learning, teaching, tutoring or 
mentoring [10] are frequently interchanged terms. The 
commonality is that each strategy is underpinned by a 
learning process whereby students learn from and with 
others; this can be with students of the same-age or 
from those who are older (cross-age). Peer assisted 
learning in physical education and physical activity may 
overcome some aspects that impede student learning, 
enjoyment and participation by providing opportunities 
for increased levels of feedback, social learning and less 
direct instruction from the teacher [11]. This is particu- 
larly important for all adolescents, but especially girls 
who experience greater age-related declines in physical 



activity levels [12] and may not be attracted to the 
sometimes competitive, rigorous and the potentially 
uncomfortable nature of physical education [13]. 

Peer assisted learning appears to be an excellent vehi- 
cle for participant improvements to health/nutrition 
outcomes [14,15], physical activity participation includ- 
ing increasing on task behaviours [16-19], skill develop- 
ment [20-24], and self efficacy [23,24]. More specifically, 
a recent study of peer assisted learning in a physical 
activity leaders (PAL) program which used resistance 
training in adolescent boys reported significant reduc- 
tions of several physiological outcomes [25], supporting 
previous findings from a lunchtime peer led activity pro- 
gram which also reported encouraging physiological 
changes in adolescents [26]. 

If peer assisted learning is conducted within a cross- 
age or same-age context then leadership opportunities 
are also provided for students. Whilst undertaking the 
role of 'peer tutor' or 'peer leader', the benefits reported 
have included; enhanced understanding of concepts, 
increased self determination, improved reorganization, 
clarification and knowledge building skills [27]. These 
leadership qualities are not exclusive to physical activity 
contexts. Promising peer assisted learning programs in 
remedial settings and other curriculum areas [28-31] 
highlight that programs outside those which are tradi- 
tionally teacher-led may be successful in influencing stu- 
dent behaviour. 

The RE-AIM health promotion evaluation framework 
[32] has been used to evaluate the multi-faceted compo- 
nents of interventions. The framework has previously 
been used in studies in primary school physical activity 
interventions [4,5,33] and community sport contexts 
[34]. The benefits of using the RE- AIM health promo- 
tion evaluation framework [32] are that it enables com- 
plex settings based interventions, such as those in 
school settings, to be comprehensively evaluated. 

In summary, considering the potential benefits for stu- 
dents associated with peer assisted learning such as lea- 
dership development, increases in psychosocial and 
physiological outcomes in addition to increasing physical 
activity participation, an intervention in schools that 
provides opportunities to develop these components and 
can also engage girls should be considered. In an 
attempt to address the afore-mentioned parameters: the 
GLAMA (Girls! Lead! Achieve! Mentor! Activate!) peer 
leadership and physical activity intervention was devel- 
oped. This paper aims to describe the process evaluation 
of the GLAMA pilot project and specifically focus on 
the evaluation of the intervention constructs including 
the; 

i) Effectiveness of leadership training and leader 
preparedness 

ii) Activity suitability and participation 
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iii) Barriers to implementation and solutions to over- 
come these to enable successful application in a wider 
school population. 

Method 

The RE-AIM health promotion evaluation framework 
[32] was used to evaluate the integral intervention com- 
ponents. Evaluating the pilot is crucial to ensure its 
future development and dissemination is successful. 
Therefore, the use of a framework at the setting level as 
well as the individual participant level will assist the 
development of interventions that are applicable to the 
unique nature of school environments. Specific aspects 
of the program evaluated are detailed in Table 1. 

Intervention development 

The intervention was designed to develop and foster lea- 
dership skills in Year 10 girls (peer leaders) so they were 
capable of leading a group of four to six girls of a 
younger age (Year 7) in a range of physical, cognitive 
and team focused activities. Based primarily on Social 
Cognitive Theory [35], the concept was also driven by 
the previous teaching experiences of the research team 
and our research into teacher perceptions, barriers and 
ability to implement physical education and physical 
activity in schools [9,36]. Ethical approval was obtained 
from both a University Human Research Ethics Com- 
mittee and the State Department of Education and Early 
Childhood Development. Parental and participant dual 
consent was obtained for participation in the leadership 
program and for questionnaire completion. 

The activities used in the program were guided by an 
'Adventure Racing' concept [37] and were based on pro- 
viding opportunities to complete 'challenges' in groups 
before moving forward to the next activity. A 'racetrack' 
consisting of a lap of the gymnasium court was also 
included between activities. The basic structure of each 
'challenge' is outlined in Figure 1. No 'challenges' 



required a high level of pre-existing motor skills or par- 
ticular sporting attributes. Primarily, 'challenges' focused 
on team work, cognitive strategies, and opportunities to 
develop positive physical activity experiences. The venue 
for each 'challenge' was a school gymnasium, but activ- 
ities could easily have been conducted in a range of 
indoor or outdoor environments. 

Participants 

Participation by the state secondary school occurred 
after teachers indicated interest in a leadership and phy- 
sical activity program. The rural school had a Student 
Family Occupation (SFO) Index rating (as determined 
by the state education department) [38] of medium 
which was within the desired low-medium rating for the 
study. A total of 67% of state secondary schools within 
the state currently have this rating. Three physical edu- 
cation teachers were involved in facilitating the project; 
two taught the Year 7 girls and one teacher recruited 
and liaised with Year 10 peer leaders to assist with the 
leadership training and program implementation. 

All Year 7 girls (12-13 years old) and Year 10 girls (15- 
16 years old) at the school were invited to participate via 
an assembly at which information was provided (Figure 
2). Year 10 peer leaders were provided with music vou- 
chers in appreciation of the time commitment required 
to lead the Year 7 students. Girls were chosen as our tar- 
get demographic as they are often underserved in terms 
of encouragement and opportunities to partake in both 
physical activity and leadership development, particularly 
in rural communities [39]. Importantly, the declining 
participation rates, predominately in girls as they pro- 
gress through secondary school were also considered a 
vital element to consider and attempt to address [12,13]. 

Implementation 

The intervention was conducted during October, 2010. 
Following recruitment, training was completed with the 



Table 1 RE-AIM health promotion evaluation framework dimensions and definitions relevant to the GLAMA 
intervention at both individual and setting levels 



Dimension 


How ability to reach dimension was measured. 


Reach 


Refers to the representativeness of the school and the individuals' willingness to participate in the study. Reasons for non- 




participation were included after being gathered from teachers and participating leaders. 


Efficacy/ 


Considers the effectiveness of the intervention at influencing primary outcome changes as well as assessing whether positive or 


Effectiveness 


negative outcomes were experienced by individuals or within the school setting. 


Adoption 


Refers to the schools acceptance of the intervention within the organization and examination of the factors that influenced that 




decision. 


Implementation 


Refers to the extent to which the participating students and school completed and made use of the various components of the 




intervention. This was measured by the level to which the main intervention components, including leadership training, activities 




and evaluations were completed as intended. 


Maintenance 


Refers to the extent to which schools and leaders maintained or continued with the intervention. This was difficult to assess 




given it was a pilot project. 



Adapted from Austin, Bell, Caperchione & Mummery (201 1) 
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TEACHERS OVERSEE TEAM SELECTION AND EQUIPMENT 
ORGANISATION PRIOR TO 'CHALLENGE' 







TEACHERS INFORM TEAMS OF 'CHALLENGE' 
SPECIFICATIONS 






LEADERS SET UP 'CHALLENGE' ACTIVITIES IN SERIES 
OF STATIONS 











TEAMS PRESENT AT START LINE WITH LEADER 



TEAMS COMPLETE LAP OF RACETRACK* & THEN MEET 
LEADER AT THE FIRST DESIGNATED STATION 



TEAMS COMPLETE STATIONS IN APPROPRIATE ORDER 
(As determined by activity cards) 



'Challenge' Activity Type 1 

Complete task within a time period (Eg. 3 minutes to 
complete the task before moving to next station). The total 
number of repetitions or tasks completed in the time equals 
points achieved. 



'Challenge' Activity Type 2 

A set number of points or targets need to be achieved (Eg. A 

total number of 150 points by hitting targets worth a 
different range of points) must be achieved before moving to 
next station. 



TEAMS COMPLETE LAP OF RACETRACK* BETWEEN EACH 
STATION 



TEAMS PROCEED TO THE FINISH LINE AFTER FINAL 
STATION TO RECORD TIME &/0R POINTS GAINED 



Note: *Racetrack is a circuit of approximately 20-30metres in distance. Its 
intention is to provide the leaders time to move to the next station and prepare for 
their teams arrival when they need to explain the next task. The racetrack also 
provides additional physical activity between each station which is important 
during the more cognitively directed challenges. 

Figure 1 Activity 'challenge' format 



Year 10 peer leaders (Figure 2). We used a 'train the trai- 
ner' model which has been successfully incorporated in 
many health contexts [40,41] and appears to be appropri- 
ate in meeting outcomes in educational contexts [42,43]. 
The aim of the one day of leadership training conducted 
by researchers was to develop appropriate skills to enable 
peer leaders to lead their small team. The training specifi- 
cally involved theoretical components, questioning, part- 
ner activities, brainstorming and group discussion to 
facilitate development. The following five key areas were 
addressed: understanding and developing leadership char- 
acteristics, developing communication skills, developing 
management skills to lead their group, and behaviour and 



motivation modification techniques. They also participated 
in the 'challenge' activities in which the role-modelling of 
both leader and participants took place. 

The GLAMA program was conducted during the reg- 
ular sport education [44] curriculum time. In the inter- 
vention school, the sport education program focused on 
gaining knowledge of game structures and strategies 
through participation in traditional games with few 
modifications. This is in contrast to fundamental skill 
development through activities and modified games pro- 
vided in physical education. Therefore, teachers felt it 
was appropriate to implement 'team-based' activities in 
their curriculum with the GLAMA intervention able to 
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INTERVENTION IMPLEMENTATION 



RECRUITMENT 



Weekl 



Week 2 

Assisted 
Implementation 

d=65 minutes 



Blindfold 
'Challenge' 



YEAR 10 GIRLS 

(Age 15-16yrs) 
n=31 



<J7 



One day training 
n=8 



Assisted Implementation 

n=8 

Participants n=7 

Non- participants n=1 

Due to external workplace 
experience 



YEAR 7 GIRLS 

(Age 12-13yrs) 
n=34 



Regular Sport Education 
Curriculum in class 



<J7 



Participation in the GLAMA 
program 

n=34 

Participants n=28 

Non- participants n=6 

Due to illness (3), absence 
from class (2), injury (1) 



Week 3 

Unassisted 
Implementation 

d=1 10minutes 

'Paper Race & Ball 
Challenges' 
implemented 





Unassisted 
Implementation 

n=8 

Participants n=5 

Won- participants n=3 

Due to external workplace 
experience, community 
leadership course, school 
athletics team 





Participation in the GLAMA 
program 

n=34 

Participants n=31 

Non-participants n=3 

Due to absence from 
class(2), injury (1) 



Data Collection 



Note: d= duration of c 



SZ 

Week 1: Leadership Training 
Evaluation (Q) 

Week 2 & 3: Evaluation of 
Assisted and Unassisted 
Implementation (Q) 

Verbal debrief & discussion of 
assisted implementation 

Week 3: GLAMA program 
Evaluation (Q) 



\z 

Week 3: GLAMA program 
evaluation (GR) 



nallenge; Q= Questionnaire; GR= group response 



Figure 2 GLAMA intervention pilot project implementation timeline 



meet similar outcomes (physical activity, team building, 
and social outcomes) to those encouraged in a tradi- 
tional sport education unit. 

The first assisted implementation was guided by the 
researchers and the three physical education teachers 



during week two. Year 7 teams were carefully chosen 
and considered friendship groups and positive, construc- 
tive relationships avoiding any confrontational issues 
which had concerned teachers previously. Peer leaders 
then completed the introduction session of 10 min with 
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their Year 7 team including getting to know you activ- 
ities and team identity formation through the establish- 
ment of rules and a team name. Teams and peer leaders 
then commenced the 'Blindfold Challenge'. The session 
was shorter than anticipated and went for 65 min due 
to externally imposed constraints of the school 
timetable. 

The final unassisted implementation of the 'Paper 
Race' and 'Ball Challenge' occurred during week three. 
Due to three peer leaders missing, some teams were 
merged with others to accommodate this. Peer leaders 
independently led and implemented activities with their 
group with assistance only provided by teachers and 
researchers when setting up equipment. The session ran 
for the duration of class time, in total 110 min. 

Data collection 

Data collection focused firstly on the one day training 
program provided for peer leaders (Figure 2). Data were 
collected using project specific questionnaires to evalu- 
ate the effectiveness of the training program in provid- 
ing the required skills and engaging peer leaders in their 
forthcoming role. Secondly, the overall GLAMA inter- 
vention was evaluated by peer leaders, teachers and 
researchers after completion of the intervention. It 
entailed the use of a mixed methods approach including 
questionnaires, reporting on observations and feedback 
from students. The researchers implemented the train- 
ing and observed all sessions conducted by the peer lea- 
ders. Evidence derived in a mixed method approach can 
offer guidance on how to create conditions for success- 
ful adoption, implementation and maintenance of inter- 
ventions [5]. As it was not the intention, no behaviour 
change data were collected from students. 

Results 

Results for the dimension REACH 

Two Year 7 girls' only classes with 34 girls in total were 
available for recruitment (Figure 2). The physical educa- 
tion teachers encouraged all girls to participate, however 
if they chose not to, they were offered alternative sport 
education opportunities in other classes during the 
intervention period. Participation during assisted imple- 
mentation (n = 28) and unassisted implementation (n = 
31) was high due to the program being run during cur- 
riculum time (Figure 2). 

A total of 31 Year 10 girls were available for leader- 
ship training: eight girls completed the training (Figure 
2). Year 10 peer leaders were difficult to reach with pro- 
blems recruiting indentified as: existing commitments to 
a large range of school programs, reluctance to leave 
classes (as they would have to catch up on missed con- 
tent), and unwillingness to work with Year 7 girls. 
There was also hesitation to engage in physical activity 



promotion or participation themselves despite the 
potential leadership advantages being gained and a small 
voucher being offered as an appreciation of their time 
and involvement. 

The three teachers were accessible and responded to 
requests for information promptly. Both Year 7 physical 
education teachers agreed that they had difficulty 
throughout the year engaging their Year 7 girls in sport 
education and were appreciative of the opportunity to 
try a different approach in an attempt to engage their 
students. 

Results for the dimension EFFICACY/EFFECTIVENESS 
Outcome 1: The effectiveness of leadership training and 
leader preparedness 

Training priorities were to equip peer leaders with skills 
to understand content, competently deliver it and 
engage their teams. All training was implemented by the 
researchers. The results for leadership training and lea- 
der preparedness are shown in Table 2. Despite only 
one day of training prior to the program commencing, 
leadership training was positively rated amongst the 
eight peer leaders with 100% of leaders reporting that 
after the completion of training they had the confidence 
to lead a group of Year 7 girls through the program 
(Table 2). All peer leaders were ready (25%), very ready 
(63%) or extremely ready (12%) to lead their groups 
after training. Uncertainty surrounding leadership prepa- 
redness after the first assisted implementation related to 
difficulties with activities (remembering them the week 
following training), and understanding the written 
instructions. In evaluating the program, a total of 100% 
of peer leaders believed that their training equipped 
them with the skills to lead their team throughout the 
whole intervention (Table 2). 

Researchers' observations of the positive outcomes of 
training and ability to implement training objectives 
during the intervention included the peer leaders: 
prompt setting up and organization across all three 
'challenges', selection and use of appropriate equipment, 
use of learned motivational techniques to encourage 
their team, quick movement between 'challenges', giving 
assistance when required to prompt their team in cogni- 
tive activities, use of activity cards and score sheets 
appropriately when difficulties arose. 
Outcome 2: Activity suitability and participation 
i) Year 7 Girls The first activity, the 'Blindfold Chal- 
lenge' was selected as it requires significant team work, 
communication, trust and a whole team contribution. 
The feedback teachers received from Year 7 students 
regarding the GLAMA program have been presented in 
Table 3. They have been grouped into common themes 
and focus on activity or program components, team 
work, and peer leader relationships. In summary, the 



Table 2 The effectiveness of leadership training and level of leader preparedness in Year 10 student leaders 



vv nen 


Outcome 
Measured 


Description 


Result 


Sample Comments 


After Leadership 
training 
(n = 8) 
Week 1 


Leadership 
training 


Would you be confident in leading a group of 4-5 Year 7 girls in the activities? 
+ 


Yes = 1 00% 


N/A 

M/A 
IN/ A 






Would you be confident in leading your peers in the activities?} 


Yes = 1 00% 






Leader 
preparedness 


1 . How 'READY' are you to lead your group of Year 7 girls?¥ 


Ready = 25% 
veiy neauy — oj/o 
Extremely Ready = 1 2% 


N/A 


After assisted 
implementation 
(n = 7) 
Week 2 


Leader 
preparedness 


2. Did you find anything difficu t about: 
a) any activities} 


INO — OU70 

Not sure = 14% 


A bit hazy on most, needed showing what the 
activities were" 






b) working with year 7 students} 


No = 100% 


N/A 






c) understanding written instructions} 


No = 86% 
Not sure = 14% 


"Some were a bit confusing". 






d) using equipment} 


No = 100% 


N/A 






e) comprehending the challenge} 


No = 86% 
Not sure = 14% 


N/A 






f) leading the group} 


No = 100% 


N/A 




Leader 
preparedness 


3. Did you feel confident leading your group in the activities today? } 


Yes = 86% 

INOl SUlc — I H /0 


"I was excited to be a leader for the Year 7's". 




Leader 
preparedness 


4. How 'READY'are you to lead your group of Year 7 girls again next week? ¥ 


Ready = 28.5% 
Very Ready = 43% 
Extremely Ready = 28.5% 


N/A 




Leader 
preparedness 


5. How 'MOTIVATED' are you to work with your group again next week?¥ 


Fairly Motivated = 43% 
Very Motivated = 43% 
Extremely Motivated = 14% 


N/A 


Debrief session 

between 

implementations 

(n = 7) 


Leader 
preparedness 


A debrief session provided for leaders to discuss their first session and address 
any difficulties that they may have experienced in preparation for the next 
implementation. No structured questions were asked. 


N/A 


N/A 


After unassisted 
implementation 
Program 
evaluation 
(n = 7) 
Week 3 


Leadership 
training 


6. Did your training equip you with the skills to lead your team?} 


Yes = 1 00% 


"It was hard to getting the girls motivated..." 
"We didn't have enough time to complete the 
challenge" 

"At the beginning everyone was shy..." 
"I had difficulty engaging them" 




Leader 

preparedness 


Were you adequately prepared each week to lead your group?} 


Yes = 71% 
Not sure = 29% 


N/A 






Did you like leading and working as part of a team to achieve the 'challenges'?} 


Yes = 86% 


N/A 



Not sure = 14% 



Note: 4= = 3 point Likert scale = "Yes", "No", "Not sure"; ¥ = 5 point Likert scale = "Not at all", "Close", "Ready", "Very", "Extremely"; Assisted implementation = first session where leaders were given assistance as 
required from teachers; Unassisted implementation = second session when leaders worked independently to lead their groups 
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Year 7 girls enjoyed many elements of the activities. 
However, the 'racetrack' component of the 'challenges' 
was not viewed quite as favourably (Table 3). Working 
with peer leaders, with peers and in teams was well 
received. In relation to affective development opportu- 
nities; girls wanted to choose their own groups, but also 
commented that swapping groups to work with others 
may also be of benefit to helping them get to know 
people. 

In terms of active participation, researchers noted that 
Year 7 participation increased following the first imple- 
mentation (n = 28) where three of six non-participants 
sat themselves out prior to commencing the activities. 
There was a different atmosphere during the second 
implementation (n = 31) when students were anticipat- 
ing the next 'challenges'. Only one student was sitting 
out due to an injury, the other two students were absent 
from class. It was evident throughout three 'challenges' 
that students were engaged, working as a team and 
actively completed laps of the racetrack by either run- 
ning or walking fast. Only one student decided not to 
take part in the final 'challenge' activity. 
ii) Year 10 Peer Leaders All seven peer leaders who 
completed the training and implemented at least one 
'challenge' completed the program evaluation. One peer 
leader was only available for the training and did not 
implement any 'challenges'. As per Year 7, responses 



were themed (Table 3). To summarize the findings 
reported by peer leaders, the activities were perceived as 
fun. However, some aspects such as filling out surveys, 
the time of the day when delivered and packing up were 
small process issues which detracted from their enjoy- 
ment. Nevertheless, the experience of being peer leaders 
was underpinned by their enjoyment of being and com- 
municating with, and helping the Year 7 students. 
Hi) Teachers Both Year 7 physical education teachers 
were asked to respond to a series of questions relevant 
to the outcomes of peer leader preparedness, activity 
participation and suitability. Their responses have been 
compiled (Table 4) and highlight the suitability of the 
activities for motivating students to participate. The pro- 
gram also assisted in drawing attention to components 
of the activities that should be further considered; com- 
petitiveness, student groupings, timing of the activities 
in the school year, and engaging otherwise disengaged 
students. 

Results for the dimension ADOPTION 

The physical education teacher who recruited the Year 
10 peer leaders and completed the training with leaders 
was highly motivated in terms of implementing the 
GLAMA project. The two Year 7 physical education tea- 
chers were also supportive of the project. However, fac- 
tors which hindered their full involvement included: a 



Table 3 Participant responses to selected questions from the program evaluation (Year 7 and Year 10) following the 
GLAMA pilot program 





What was the best part of the GLAMA program? 


What was the worst part of the GLAMA 
program? 


YEAR 7 RESPONSES (n = 31) 


Activity/Program 


"All the activities were fun" 

'The first weeks' activities (referring to the Blindfold Challenge)" 
"It was fun" 

"We liked that it was competitive" 
"Helps you to get fit" 


"We had to run a lap after every activity" 
"The running a lap" 
"Running around the room" 


Team Work 


"Working in teams" 

"Working with others" 

"Working with my friends" 

"Working together" 

"Helps you to get to know people" 


"We wanted to choose own group" 

"It was different because you weren't working 

with friends" 

"We should swap groups after every challenge" 


Peer leader 
Relationships 


"Working with a year 10 leader was good as they are not so cranky and are 
different to teachers" 

"Because the Year 1 0's are closer to age group...easier to connect to" 
"Lots of positive feedback from the leaders" 




YEAR 10 RESPONSES (n = 7) 


Activity/Program 


"It was fun and exciting" 
"Everyone had fun" 
"It was mostly good" 

"It was great, except 1 missed the second session" 


"That it was at the end of the day" 
"Packing up" 
"Filling out surveys" 


Team Work 


"Getting to work with and help the Year 7's" 

"It was something new...l got to work with people who 1 wouldn't normally" 
"Helping out the Year 7's" 


"Some of the girls (Yr 7's) were a bit lazy to 
begin with" 


Peer leader 
Relationships 


"Being with the girls" 

"Communicating with the Year 7 girls and getting them motivated" 
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Table 4 Physical education teacher responses to the GLAMA programs' ability to meet the primary outcomes 



Teacher 
Responses 



Leadership Preparedness 



Activity Participation 



Activity Suitability 



Teacher (1) "It was definitely beneficial having the year 
10 students involved....younger students 
looked up to them and I think they almost 
wanted to prove themselves to them, to 
show them that they were capable of 
being mature and capable of performing 
skills. It was fantastic to see the Year 10's 
step up and take on a leadership role 
within the school." (1) 



"During the first session we saw many of the 
students who do not usually participate 
having a go at all the activities (which was a 

big positive) students worked well with 

students who they do not usually work with... 
enthusiasm and confidence increased. We 
saw some of the 'typical' non-participants pull 
out halfway through activities during the 
second session. This could have been due to 
a decline in confidence as some of the 
activities were harder than the previous 
week's activities." (1) 



"A program like this would be extremely 
beneficial for year 7 girls at the start of the 
year as many of the students would not 

have formed close friendships yet give 

students a chance to work with everyone in 

a positive team environment. In addition 

this allows students who are not so 
confident or do not like physical activity to 
participate in physical activity without even 
knowing it. Students such as this may see 
physical activity as a positive and fun thing 
rather than an exhausting task." (1) 



Teacher (2) "...Year 1 0 students seem to engage the 
Year 7 students. They were able to get 
students who don't normally participate to 
have a go, which was great to see." (2) 



'Team work was one aspect that I think 
improved (through participation) as well as 
developing new friendships." (2) 



"I would consider continuing on; it's just a 
matter of getting our hands on the right 
resources." (2) 



deficiency in knowledge of program development, pro- 
gram structures and implementation procedures. Other 
factors that may have influenced adoption were the 
schools extra curricula programs that occurred simulta- 
neously and included another external leadership oppor- 
tunity, sports team commitments, academic testing and 
workplace experience. Timetabling priorities also 
affected the first assisted implementation, with class 
time reduced to facilitate a presentation assembly. 

Results for the dimension IMPLEMENTATION 

The pilot school implemented most components of the 
program. Factors limiting the implementation process 
included; 

♦ Peer Leader availability: Seven peer leaders com- 
pleted the first assisted implementation and only five 
leaders were available for the unassisted implementa- 
tion. Absences were due to sporting team commit- 
ments, external school courses, workplace 
experience and other school programs (Figure 2). 

♦ Year 7 participant absences: Absences were due to 
illness, sporting or other school commitments such 
as music lessons (Figure 2). 

♦ Duration: Initially the pilot was designed over a 6 
week period. This was to include 2 days of leader- 
ship training in the first week. This was to then be 
followed by four "in class" sessions for 65 min per 
week over a 4 week period (4 x 65 min). It would 
then conclude with the lunchtime sessions, one 
lunchtime session of 40 min per week for the dura- 
tion of 2 weeks (2 x 40 min). 

However, the school would only release the Year 10 
leaders for 1 day of training. Additionally, it was decided 



between staff and researchers that the four single ses- 
sions could be provided in two double sessions, there- 
fore including the exact same content but over a shorter 
duration (2 weeks rather than four weeks). Circum- 
stances beyond the control of the researcher reduced 
one double session to only one single session. 

The peer leaders were very reluctant to give up their 
time to commit to a program over a total of 6 weeks 
but were happy to do so over a lesser time frame. The 
peer leaders also considered their lunchtime as an 
important period of the day and therefore after discus- 
sions with them it was decided to remove the lunchtime 
component. Year 7 students when asked also suggested 
their own time to socialise at lunchtime was more 
important than participating in the program. 

♦ Team selection: In this pilot program teams were 
selected by teachers prior to the program. However, 
one teacher noted that "...perhaps, teamwork 
declined a little in the second session as some of the 
students believed they should have been given the 
opportunity to work with their friends..." (Teacher 1). 

♦ Time and cost of intervention: All three 'chal- 
lenges' involved equipment that was sourced from 
around the school and from the physical education 
resources already available. The main cost was in 
student time taken away from class. For the peer lea- 
ders, classes missed had to be made up in their own 
time. For Year 7 students, because it was during cur- 
riculum time the impact was minimal. 

♦ Time of year for implementation: The program 
was implemented toward the end of the school year 
when friendship groups have already been estab- 
lished in Year 7. Year 10 peer leaders also had com- 
peting demands of preparing for exams. 
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Results for the dimension MAINTENANCE 

As this was a pilot intervention, maintenance was diffi- 
cult to evaluate because of the short duration. However, 
a positive result was reported by physical education tea- 
chers at the intervention school during December 2010. 
Of the leadership group who completed training, seven 
of the eight Year 10 peer leaders continued their leader- 
ship at the school and were peer support leaders for the 
Year 7 students the following year. 

A review of outcomes including the potential barriers 
and possible solutions to enable successful implementa- 
tion and dissemination of this project in the future can 
be found in Table 5. The three main considerations that 
need to be addressed and were evident across more 
than one RE- AIM dimension include: 

i) Developing teacher, school and student 
participation. 

ii) Translation of leadership training. 

iii) Consistent activity implementation. 

Discussion 

Overall engagement of the school, teachers and students 
was appropriate during the pilot. All teachers attended 
each session, there was an increase in Year 7 participa- 
tion over the three 'challenges' and the lowest atten- 
dance by peer leaders was five of the available seven 
students during week three which was affected by exter- 
nal school activities. 

Over a longer duration, gaining teacher and adminis- 
tration support in a school setting is imperative for 
intervention sustainability. Similarly to previous studies, 
we have found that having a 'program champion' to 
develop momentum and drive the program from within 
the school has shown to be influential in the success of 
school-based interventions [45,46]. Importantly, in con- 
junction with appropriate staff training [46,47], it can 
maximize opportunities for all involved and possibly 
enable the project to become embedded more broadly 
within the school culture. 

For this peer assisted intervention to be successful it 
must be provided within timetabled lessons, and possibly 
collaborate with other programs with similar objectives 
(promote school and social connectedness, foster leader- 
ship, increase physical activity). Secondary school inter- 
vention studies such as Trial of Activity for Adolescent 
Girls (TAAG) [48] and Fitness Improvement Lifestyle 
Awareness (FILA) [26] have similarly found that the 
compulsory context of curriculum-based sessions are 
important in enabling greater opportunities for interven- 
tion success. It was evident in both our study and FILA 
[26] which involved peer assisted learning, that compet- 
ing interests at lunchtime may impact on participation. 

Supporting the developmental concepts of this pilot 
intervention, a recent systematic review of interventions 



that promote physical activity among young and adoles- 
cent girls' recommends that peer assisted learning strate- 
gies such as mentoring or tutoring should be one focus of 
future physical activity research [49] . Although the aim of 
the pilot was to specifically elucidate the effectiveness of 
the training for Year 10 leaders, the activities used with 
the Year 7 students and to see if there were any immediate 
barriers to the program within schools, it would be remiss 
to not address the fact that previous research has demon- 
strated the capacity to measure a range of different out- 
comes in peer learning contexts and these will need to be 
considered in the future implementation of the GLAMA 
program over a longer timeframe. These measures include 
physiological [20-24] as well as psychosocial outcomes 
[16-19,23,24]. Objective measures of physical activity for 
leaders and Year 7 students would be highly beneficial and 
relevant to the future implementation of the intervention. 

One of the limiting factors of many peer assisted 
learning interventions is the integrity of the leader train- 
ing protocol and whether the training provided to lea- 
ders is sufficient to secure the desired outcomes of the 
program [27]. We have found our training to be some- 
what successful after assessing researcher and teacher 
observations as well as peer leader evaluations, although 
completing the implementation of three 'challenges' is 
not a true reflection of training success. Importantly, 
gathering support from students to complete the train- 
ing and engage in the intervention also needs further 
consideration. Physical activity, peer assisted learning, or 
leadership opportunities are not attractive to all teachers 
or students. Further strategies would need to be consid- 
ered on how to address these perceptions. Research has 
suggested that incorporating peer leaders to deliver 
interventions may possibly reduce the burden on tea- 
chers and may also promote responsibility in peer lea- 
ders and a greater understanding of the program 
resulting in higher retention [25]. These outcomes may 
be important for program champions to disseminate. 

The design of the activities must provide opportunities 
for development across each of the learning domains: 
affective, cognitive and psychomotor. Supporting pre- 
vious findings from the HIKCUPS study [50], our 
research has shown that detailed activities, equipment 
and the time for activities should be clearly available in 
manuals to clarify any difficulties peer leaders may have. 
These manuals should be provided for leaders in the 
future. Furthermore, recommendations from HIKCUPS 
also highlight that the selection of activities need to be 
engaging as well as health promoting [50]. Our findings 
concur, activities need to be carefully sequenced, pro- 
vide competitive elements which participants reported 
they enjoyed, involve careful team selection and have 
clearly defined, consistent scoring, and time periods dur- 
ing individual sessions as well as the entire program. 
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Table 5 Potential barriers and solutions for GLAMA intervention using the RE-AIM health promotion evaluation 
framework [32] 


DIMENSION 


POTENTIAL BARRIERS 


POTENTIAL SOLUTIONS 


Reach 


Future implementation of a school intervention of this design must consider the following to best target individual 
participants and school settings: 


S 


Implementation during school curriculum time. 


Engage schools in program implementation during curriculum 
PE or Sport Education or potentially as an adjunct to 'Peer 
Support' Year 7 mentoring programs that many schools already 
provide. Students may not want to participate during their own 
free time such as lunchtime. 


S 


Have support and develop knowledge of the program with all 
teaching staff. 


Develop support from school and staff by providing appropriate 
professional development and handout information prior to 
implementation. Must highlight benefits to staff and students of 
their own participation. 


S 


Ensure program is not competing against other school based 
programs for time. 


Consult school calendar and highlight benefits of program for 
school transition, school connectedness, and psychosocial 
development. 


LT 


Recruitment of leaders may need a different approach. 


Program needs to be promoted as an opportunity not a right; 
therefore incentives may not be needed. Leaders need to be 
aware of benefits. Link to community service programs such as 
Duke of Edinburgh is possible. There also needs to be 
consideration of recruiting leaders who are not already involved 
in similar opportunities and who sit outside the traditional 
leader' mould. 


LT 


Return of consent forms may be an issue. 


If considered a 'compulsory' program by the school and fully 
supported, there may be a higher return rate of consent forms. 


Effectiveness 
/Efficacy 


Consideration of the following will be needed to ensure leader competency, confidence and preparedness: 


LT 


Training protocol. 


OUTCOME 1: Leadership training and leader preparedness. 

1. Training programs should be clearly designed to meet 
appropriate outcomes to ensure that it will enable successful 
implementation of the interventions. Leaders should gain 
knowledge in the five key areas established in this pilot. 


LT 


Training duration. 


An intervention that is implemented over a longer duration 
would require more training to be able to conduct more 
'challenges' and greater understanding of group dynamics, 
leadership skills and how to problem solve. Refresher training 
just prior to the first implementation should be undertaken to 
help check for understanding and address any concerns or 
apprehensions. 


LT 


Length of time between sessions. 


'Challenges' should be completed weekly to ensure a consistent 
team oriented approach otherwise leaders lose momentum and 
also understanding of tasks and their role. 


LT 


Reading and comprehending instructions for each activity. 


Provide a booklet with all 'challenges' for leaders to take home 
and use to prepare. Ensure activity cards are clear and concise 
with diagrams and that leaders have opportunities to clarify 
before implementation. 


LT 


Opportunities to evaluate training and verbal feedback. 


Leaders should be given the opportunity to provide both 
written and verbal feedback to help direct support they require 
to develop their leadership skills. 


The following issues need to be addressed when providing activities for Year 7 students: 


A 


Sequencing activities correctly to engage students. 


OUTCOME 2: Activity suitability and participation 

The first task completed should be challenging, engaging and 
provide an opportunity for students to contribute to team 
success. 


A 


Removal or adaptation of racetrack. 


The racetrack element should be carefully considered in terms 
of its: length, application in more cognitively based activities to 
encourage activity, its benefits to leader organisation, its location 
and participant understanding of its purpose, how frequently it 
is used and the primary outcomes of the program challenge. 


A 


Adding competitive elements. 


Scoring should be consistent between activity 'challenges', easy 



to use and fully explained in the activity cards and booklets 
leaders have. 
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Table 5 Potential barriers and solutions for GLAMA intervention using the RE-AIM health promotion evaluation frame- 
work [32] (Continued) 



A 


Grouping of students in teams 


Appropriate grouping of teams and also leaders to teams is 
paramount to intervention success and should be considered 
carefully. If leaders are working with other leaders, this should 

alcn hp rnnsiHprpH Tpams should hp ^msll hptwppn 4 tn f\ 

OIjU kJC Lul JlUCI CU 1 COl 1 Ij Jl UUIU kJC Jl 1 lull, 1 ^ LU \J 

students if possible. 


LT 


Leader interest and understanding of activities and ability to 
motivate students. 


Leader motivation and interest will be critical to Year 7 activity 
participation. All leaders should apply for positions of 

rpsnnn^ i hi 1 ifv and nntpnfialh/ Hpmnn^tratp thpv ha\/p fhp 

ICTjUUIlJlLJIIILy Gl IU kJULCIILIQIIV UCIIIUIlJlluLC 1 1 1 try 1 IQVC LIICT 

capacity to undertake this role. Leaders must complete training 
that promotes positive relationship building, communication 
skills, problem solving and ability to work with others in groups. 


A 


Disappointment in team/grouping. 


Inappropriate grouping may lead to decreases in participation. 
Year 7 groups and students should be monitored throughout 
the program with groups confirmed as early as possible if 
changes are required. 


A 


Concern about being part of a losing team. 


Bonus points can be given by supervising staff to leaders and 
teams for assisting with equipment, organization and 
appropriate 'team work' to reward desirable team related 
outcomes. 


A 


Time to complete the activity. 


Time periods must be designated for each challenge and be 
consistent throughout the program. This will allow scoring to 
also be consistent between activities. 


Adoption 


The following issues need to be addressed to promote setting adoption: 


S 


Teacher knowledge and support of the program. 


See REACH 1 . 



S School culture including previous lack of success with students, The program should be promoted to all students, with leaders 

motivational issues with students and negative experiences comprehending the importance of the role they will play, 
with physical activity. Motivational issues and negative experiences with physical 

activity can be negated by limiting racetrack lengths, careful 
team selection, ensure leaders are motivating and encouraging 
and appropriate challenge activity selection to meet student 
needs. 



s 


Too many extra curricula activities already offered by the 
school. 


1. See REACH 3. 


Implementation 


To encourage successful implementation of this intervention, the following components need to be considered: 


S 


Leader availability for each session. 


A consistent time every week needs to be provided for both 
leaders and students to ensure they attend, can plan for and 
contribute to each session. If leaders are absent, it impacts 
greatly on their peers and also other teams. 


S 


Participant contribution to team each 
session. 


All participants should be held accountable for their team 
success after each challenge. This could be in the form of 
contributing individual points or overall team points. Teams 
crossing the finish line together and presenting to leaders 
together is also an important component in achieving this. 


S 


Consent. 


See REACH 4. 


S 


Length of program and training within 
the school program. 


The training duration provided for leaders has to equate to the 
period of implementation. 


S 


Team Selection. 


See EFFECTIVENESS Outcome 2, 4. 


S 


Time and cost. 


The outlay for equipment is minimal. The time taken for leaders 
to leave their classes to conduct the program is the most costly 
aspect of the program. Potentially timetabling a Year 10 and 
Year 7 class together for PE, Sport Education or Peer Support 
may alleviate this. Otherwise, classroom teachers need to be 
informed of when leaders will be missing and provide 
appropriate avenues for them to make up class time. 


S 


The time of year to deliver program the program to Year 7 
students (weather, transition, exams, sport). 


One of the aims of the program is to assist with Year 7 
transition and therefore the optimum time for delivery is Term 1 
or Term 2 of the school year. Optimal training time for leaders 
also needs to be taken into consideration, with exams and other 
commitments sometimes filling senior students' diaries. Weather 
will also impact on location/facility requirements. 
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Table 5 Potential barriers and solutions for GLAMA intervention using the RE-AIM health promotion evaluation frame- 
work [32] (Continued) 

Maintenance For a school to maintain a program and embed it within the school, the following parameters should be addressed: 

LT The duration of training and when to deliver the training. A comprehensive training program should be undertaken to 

ensure leaders are competent and capable in leading their Year 
7 teams. Provision of training periods should be included within 
the school day. The timing of training should also be considered 
otherwise refresher training will need to be provided. If the 
program is to be delivered at the start of a year, consideration 
needs to be given to leader selection and training beginning at 
the end of the previous year (see also EFFECTIVENESS Outcome 
1,2). 

All Year 7 students should have opportunities to partake in the 
'challenges'. The biggest impact will be on Year 10 students 
who will have to miss classes if classes are not timetabled 
concurrently. 

S Staff required. Staff training is required for those staff that will be assisting Year 

10 leaders when the program is actually running. This will 
enable them to provide valuable feedback while the student 
leaders implement the program. Recruitment of key staff that 
will help drive and oversee the intervention is crucial to its 
success. Ongoing training of new staff to a school setting is 
necessary. 

Potential barriers include those relevant to: S staff and school, LT Leadership training, A Activity/program design, selection or participation 



S Impact on school having both year 7 and year 10 students 

participating in program. 



Limitations 

Process evaluations are important components of inter- 
vention research [48]. The RE- AIM health promotion 
evaluation framework was used in this evaluation and 
has identified a range of different outcomes and limita- 
tions that should be considered prior to further imple- 
mentation and dissemination of the GLAMA program. 
Firstly, the school chosen was rural, and despite being 
similarly ranked with two thirds of other schools within 
the Victorian state secondary system, the influences on 
rural students' participation in such programs may be 
different to their metropolitan counterparts. The sample 
of eight female leaders who undertook training and 
seven female leaders who implemented the project also 
limits external validity. 

The use of self report lends itself to reliability issues, 
memory bias and problems with concentration and com- 
prehension [4] . In an attempt to overcome these problems, 
questionnaires were completed immediately after training, 
program implementation and program completion. Time- 
table restrictions dictated timeframes for completion of 
tasks and may have influenced results; however, this is the 
reality of conducting interventions in school settings. 

The duration of the intervention for 3 weeks does not 
provide knowledge of the long term difficulties within 
the setting and with participants to be fully understood. 
Although not the primary objective of this process eva- 
luation, it also did not enable us to assess any immedi- 
ate behavioural change in peer leaders or Year 7 girls, 
which is something interventions of a longer duration 
would need to consider. 



Conclusions 

Despite barriers experienced by students and teachers at 
an individual level, the factors having the greatest 
impact on intervention success are those coming from 
within the school setting; the structure of the curricu- 
lum, timetabling, pressure to meet curriculum and 
assessment content, lack of support for new initiatives, 
multiple programs already running within the school, 
time allowances for teachers, appropriate training for 
teachers, and support of students to participate. A 
school's ability to adopt, implement and maintain pro- 
grams needs to be considered most prominently in plan- 
ning future implementation of school-based physical 
activity interventions [5,51] as well as those within other 
curriculum areas. 

The GLAMA pilot intervention provided opportunities 
for leadership development, physical activity and social 
interactions for participants, all of which can be mea- 
sured in its future application. Overall, it was a positive 
experience for Year 10 leaders, Year 7 girls and physical 
education teachers. The intervention should be revised 
using the recommendations from this study to further 
encourage a range of other school settings to adopt 
such programs, and considerations should include pro- 
moting involvement to both boys and girls in a cross- 
age environment over a longer duration. 
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